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Abstract 

'-^ The enumeration of standard Young tableaux (SYTs) of shape A can be easily 

1—5 computed by the hookdength formula. In 1981, Amitai Regev proved that the number 

of SYTs having at most three rows with n entries equals the nth Motzkin number 
M n . In 2006, Regev conjectured that the total number of SYTs of skew shape A/(2, 1) 
over all partitions A having at most three parts with n entries is the difference of two 
Motzkin numbers, M n -\ — M n _3. Ekhad and Zeilberger proved Regev's conjecture 
using a computer program. In his paper [2], S.-P. Eu found a bijection between Motzkin 
paths and SYTs of skew shape with at most three rows to prove Regev's conjecture, 
and Eu also indirectly showed that for the fixed u = {p,\- l \i'i) the number of SYTs of 
skew shape A/u over all partitions A having at most three parts can be expressed as 
a linear combination of the Motzkin numbers. In this paper, we will find an explicit 
formula for the generating function for the general case: for each partition ^ having at 
most three parts the generating function gives a formula for the coefficients of the linear 
combination of Motzkin numbers. We will also show that these generating functions 
are unexpectedly related to the Chebyshev polynomials of the second kind. 

en 

O 1 Introduction 

A partition A of a nonnegative integer n is a weakly decreasing sequence 
> 

$ A=(Ai,A 2 ,...,A,) 

such that Yli=i \ — n and A; > 0. The integers A« are called parts. The number of parts of 
A is the length of A, denoted /(A). We denote Par(n) to be the set of all partitions of n, with 
Par(0) consisting of the empty partition 0, and we let 

Par := U ra >o Par(n). 

If A G Par(n), then we also write A h n or |A| = n. Any partition A can be identified with 
its Young diagram, which is a collection of boxes arranged in left-justified rows with the ith 
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row containing Aj boxes for 1 < i < /(A). If A and /i are partitions such that \Xi < Aj for all 
z, we write /i C A. Let us assume |A| = n and /x C A throughout this paper. 

A skew shape A//i is a pair of partitions (A, /i) such that the Young diagram of A contains 
the Young diagram of \i. If /i = 0, then we assume that A//i = A. A sAiew Young diagram of 
shape A//i is a Young diagram of A with a Young diagram of /i removed from it. A standard 
Young tableau (SYT) of skew shape A//i is obtained by taking a skew Young diagram of shape 
A//i and writing numbers 1,2, ... ,n in the n boxes of this diagram such that the numbers 
increase from left to right in each row and from top to bottom down in each column. A 
Young tableau is called semistandard (SSYT) if the entries weakly increase from left to right 
in each row and strictly increase from top to bottom down in each column. The size of a 
SSYT is the number of its entries. As shown in Figure below, (a) is a Young diagram of 
shape (4, 3, 1), (6) is a SYT of shape (4, 3, 1), and (c) is a SYT of skew shape (4, 3, l)/(2, 1), 
respectively. 
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Now let us review several definitions for symmetric functions [12]. Let x = (#i,£2, . . .) 
be a set of indeterminates. For n G N, a homogeneous symmetric function of degree n over 
the complex number field C is a formal power series 

f( x ) = ^2c a x a , 



where a ranges over all weak compositions a = (oi, 02, • • •) of n, c a G C, x a stands for the 
monomial x^x^ 2 ■ ■ ■ , and /(^(i),a ; w(2), • • •) = f(%i,%2, ■ ■ •) for every permutation uj of the 
positive integers P. Note that a symmetric function of degree zero is just a complex number. 
The monomial symmetric functions m\ for A G Par are defined by 



m A 



==E 



x 



where the sum ranges over all distinct permutations a = (011,0:2, • • •) of the entries of the 
vector A = («i, 02, • • •)■ 

The complete homogeneous symmetric functions h\ for A G Par are defined by the for- 
mulas 

K := ^2 m ^ = ^2 Xi i'" x *«' for n - 1 ( witn h o = X ) 

h\ = h\ 1 h\ 2 --- if A = (Ai,A 2 , ...)• 

Let A//i be a skew shape. The skew Schur function sa/ m = sx//i{x) of X/fi in the variables 
x = (xi,x 2 ,. 



is the sum of monomials 

s\/n{x) -=^2x T = ^2x[ 1 



x 



t-> 



T T 
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summed over all SSYTs T of skew shape X//J, where each ti counts the occurrences of the 
number i in the SSYT T. If fi = 0, (that is, X/fi = A), then we call s\(x) the Schur function 
of shape A. For example, the SSYTs of shape (2, 1) with largest part at most three are given 
by 
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So, we have 



S(2,1){X1,X 2 ,X 3 ) 



x t X2 + x\x 2 + x t X3 + X1X3 + x 2 X3 + X2X3 + 2:ri:r2£3 
m( 2 ,i)(xi, z 2 , ^3) + 2m(i,i,i)(si, x 2 , x 3 ). 



2 About standard Young tableaux having at most three 
rows 

In their paper [5] , Gordon and Houten showed that the sum of Schur functions of skew shape 
A//i, for fixed \i over all partitions A with at most a fixed number of rows, can be expressed 
as a Pfaffian of a matrix of complete homogeneous symmetric functions. Before we state 
their results, let us define the functions h, g^ and fj used in them. 
For i > and j > 1, let us define h, g^ and fj by 



oo 



CO 



h-.= j2 h n = J2J2 mx 

n=0 n=0 Ahn 

CO CO 



g. ■= Y^ KK+i = ^2 5Z mAl 5Z mA2 ' 
n=0 n=0 Aihn A2hn+« 



and 



fj ■■= 9o + 2(01 + • • • + <7j-_i) + <fc. 
Gordon and Houten proved that 

J2 s x/fl = Pf(D 2m ), 

l{X)<2m 



where Pf denotes the Pfaffian and D 2 m = (/. 



\i—[j,j-{-j—i)l<i,j<.2rm 



and 



E 



?A/ M 



Pf 



i(A)<2m+l 



H 
-H f D 



2m 



where the matrix is obtained by bordering D 2m with a row H of /i's, a column —if* (transpose 
of —H) of — /i's, and a zero. 



For \x = 0, Gordon [4] showed that 

^ s x = det(gi_j + g i+j -i)i<ij< m , (2) 

l(X)<2rn 

and _ 

22 s a = hdet(gi_j - g i+j )i<ij< m - (3) 

/(A)<2m+1 

For the case m = 1, identity (2) reduces to 

Y^ Sx = 9o + 9i- (4) 

l(X)<2 

We can directly prove identity (4) by considering the two cases of partitions of even or odd 
numbers and then by applying Pieri's rule to each case. For m — 1, identity (3) reduces to 

Y Sx = K90-92), 

Z(A)<3 

which can also be proved by applying Pieri's rule to expand hg^ and hg2- 

To count SYTs of skew shape X/fi, we need to find the coefficient of £1X2 • • • x n -\(i\ in 
S\/fj,. Now let us transform symmetric functions into formal power series by applying the 
map 9 from the algebra of symmetric functions to formal power series in x, which is defined 

by 

, . J x r /r\, if A = (l r ) for some r 
^ 0, otherwise 

and extended by linearity. Then we can easily show that the map 9 is a homomorphism with 
the property 

9{h n ) = -^. 
Let us apply the linear map 9 to g,i. For i > 0, we have 



n=0 
00 

n=0 
00 

= E 



f-yilb / -y t I V I L 



n\ (n + 1)\ 

n=0 v ' 

00 /O 1 \ 

Y^ / In + i\ x 

ra=0 



n J (2n + i)\ 



Now we want to convert the generating function 9(gi) to an ordinary generating function. 
To do this, we need the following lemma. 
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Lemma 2.1. Define L to be the linear map from the algebra of formal power series C[[rr]] 
to itself defined by r£ j *— y x n , extended by linearity. Then we have 

L(e x f(x)) = — L- f(^), where F ^ = L (f( x ))- 
Proof. Let f(x) = Y.n=o a n^r- Then F ( x ) = L (f( x )) = Y.n=o a n% n and 

oo n 

L(e x f(x)) = S^a n L(e x — J by linearity 

n=0 

E( sr-^ ( n + k\ x n+k 
a n L(^ 



x k J(n + k)\ 

OO OO / , \ 

n + k ]xk 



oo oo / 

ra=0 fc=0 ^ 

2^a n — 



._ -x) n+1 

1 „/ X 



1 — X \1 — X< 

Let c(x) be the Catalan number generating function 






1 - VI - 4x 

C(X) = > O n I" = > -I \x~ = - 



E M « 



mix) = > M n x n 



D 



2x 

n=0 n=0 x ' 

and m(x) be the Motzkin number generating function 

1 — x — a/1 — 2x — 3x 2 

"nX~ = ^ , 

n=0 

where M n = Y2^Z n\/ (k\(k + l)!(n — 2/c)!) is the nth Motzkin number. From the well- 
known fact 

we can express the Motzkin number generating function in terms of the Catalan number 
generating function: 

m(x). 



1 — x \(1 — x / 

Let ty := L o 9. Then \1/ is a linear map from the algebra of symmetric functions to the 
algebra of formal power series C[[x]]. 



Now let us compute ^(gi) for i > 0. 



/y> /2n + A x 2 "+* 
n 

n=0 



£ 

=0 

x l c(x 2 ) 1 
sj\ - Ax 2 



(6) 



where the last equation follows from identity (5). 

For j, k > 1, let us consider a partition /x = (/xi, /x 2 ) having /xi = j + fc — 2 and /x 2 = j — 1 
in equation (1). Then equation (1) reduces to 

Yl s Vm = Kfj + fk~ fj+k)- (7) 

Z(A)<3 

Let G 3 (/ii,/x 2 ) be the sum (7). That is, 

G 3 (j + k-2J-l) = h(f 3 + f k - f j+k ). (8) 

Now let us first consider the case /x = (k — 1, 0), that is, /x = (k — 1). Letting j = 1 in 
equation (8), we can find the number of SYTs of skew shape \/{k — 1) over all partitions A 
of n having at most three parts, filled with the numbers 1, 2, . . . , n — k + 1. Since 

/n = go + 2(5-1 H h flf R _i) + s> n for n > 0, 

we have 

G 3 (& -1,0) = % + 9i- 9k- S-fe+i)- 

By equation (6) and Lemma 2.1, we have 

*{hg k ) = L(6{hg k )) 

= L(e(h)B(g k )) 
= L(e x 9{g k )) 

x \ k ( x 2 \ k 1 



1-s/ V(l-x) 2 / Vl - 2a; - 3x 2 
x fc m(a;) fc 



Vl - 2x - 3x 2 

To simplify the term that we computed above, let us define a k by 

a k ■= ty(hg k ), for all k > 0. 
Then we have a k = x k m{x) k j\f\ — 2x — 3x 2 . 

6 



(9) 



To find the number of SYTs of skew shape \/{k — 1) over all partitions A of n having at 
most three parts, filled with the numbers 1, 2, . . . , n — k + 1, let us apply \& to G%(k — 1,0). 
Then by linearity we deduce 

^(G 3 (k - 1, 0)) = a + «i - a k - a k+1 

1 + xm(x) — x k m(x) k — x k+1 m(x) k+1 

Vl - 2x - 3x 2 
(l + xm(x)) (l — x k m(x) k ) 
\/\-2x- 3x 2 

= - — m \ , , 9 (l + itn(i)) (l - x k m(x) k ) 
1 — x z m{x) z 

" !il ' ] -{l-x k m{x) k ). (10) 



1 — xm(x) 

For example, consider the case k — 1 in (10), that is, \x — 0. Then we know that the 
number of SYTs of shape A over all partitions A of n having at most three parts, filled with 
the numbers 1,2, ... ,n, is equal to the nth Motzkin number since 

tt(G 3 (0,0)) =m{x). 

Consider the case k = 2 in (10), that is, /j, — (1). Since the Motzkin number generating 
function m(x) satisfies the functional identity 

m(x) = 1 + xm(x) + x 2 m(x), 

we deduce 

*(G 3 (1,0)) = m(x){l + xm(x)) 
mix) — 1 



x 



This tells us that the number of SYTs of skew shape A/(l) over all partitions A of n having at 
most three parts, filled with the numbers 1, 2, . . . , n — 1 is equal to the nth Motzkin number 
for n > 1. 

Now let us find the generating function for ^^Gs(k — 1,0)) for k > 1. From (10), we 
have 



V(a + ai - a k - a k+l )y k = V mK ?> l\ _ x k m ( x ) k ) y 

*— ' ^^ 1 — im x 

fe=i fc=i v 7 

mfx) / 1 



1 — xm(x) \l — y 1 — xym(x 

.2 



-•7- 

m(x), (11' 



(1 — y)(x + xy — y + xy 2 ) 
xy 



(1 - y)(x + xy - y + xy 2 ) 

7 



where the last equation follows by rationalizing the denominator. By factoring the denom- 
inator of the first expression in the right side of equation (11), we have 

y2 y2 (12) 



(l-y)(x + xy-y + xy 2 ) x(l -y)(l + y-y/x + y 2 ) ' 

so when expanded in powers of y, the function (12) has only negative powers of x. However, 
the left side of equation (11) has no negative powers of x. So we can conclude that the 
function (12) must be cancelled with negative powers of x from the second expression in the 
right side of equation (11). Therefore, we know that the generating function for ^>(G^{k — 1)) 
is the part of 

%y / x 

(I - y)[x + xy - y + xy 2 ) 

consisting of nonnegative powers of x. 

Let 

R{x,y):= T — ■ ■ jt-. (13) 

(1 — y)(x + xy — y + xy z ) 

By factoring 

xy y 



(x + xy — y + xy 2 ) 1 + (1 — x x )y + y 2 ' 

we can see that the coefficient of y n in (13) is a polynomial in 1/x. So there are polynomials 
fk{x) = Ylii r k,i x% suc h that the function (13) can be written as 



X. 



y v* / M„.* 



(1 - y) (1 + (1 - x~ l )y + y 2 ) f-f \x 



fe=i 



E r *bK- (14) 



Now we need to compute the coefficient of x n ~^ k ~ 1 ^y k in the expression R(x,y)m(x) to 
find the number of SYTs of skew shape X/(k — 1) over all partitions A of n having at most 
three parts, filled with the numbers 1, 2, . . . , n — (k — 1). By (14), we have 

[x n - k+1 y k ]R(x,y)m(x) = [x n ~ k+l }r k (-\ m(x) 

= [x n - k+1 }f^M t x i r k (-) 

oo 

= [x n - k+1 ] J2 Mix'rkjX-' 

i,j=0 

= / _, Mi r k,i-n+k-l 
i 

= / ^^+n-fc+l r fc,t- 
i 

So, we summarize with the following theorem. 
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Table 1: The values of tv, 



Theorem 2.1. For k > 1, the number of standard Young tableaux of skew shape X/(k — 1) 
over all partitions X of n having at most three parts, filled with the numbers 1, 2, . . . ,n — k+1 
can be written as the linear combination of Motzkin numbers 



J2 r ^ M > 



i+n— k+1: 



where the number M n is the nth Motzkin number and the coefficients rk,i are defined by 

oo oo fc— 1 



E r ^ fc = EE 



Tk,iX y 



y 



(l-y)(l + (l-x)y + y 2 y 



fc=l fc=l i=0 

Table 1 shows the coefficients r^j for k from 1 to 8. 

2.1 Generalization of Theorem 2.1 

Now we want to consider a generalization of Theorem 2.1; for a partition fi having at most 
three rows, we want to express the number of SYTs of skew shape X/fi over all partitions A of 
n having at most three parts, filled with the numbers 1, 2, . . . , n— |/x|, as a linear combination 
of Motzkin numbers. It is enough to consider partitions \i having at most two rows. 
First let us compute ^(hfk) for k > 0. By equation (9) we have 



V(hf k ) = L(e(h(g + 2(0i + • • • + <fc_i) + g k 

1 + 2{xm{x) H h x k ~ 1 m{x) k ~ 1 ) + x k m(x) k 

r k+1 m(x) k+1 + xm{x) — x k m(x) k 



y/\-2x- 3x 2 

1 1 

Vl - 2x - 3x 2 1 - xm(x) 

m(x) (l + xm(x)) (l — x k m(x) k ) 
1 — x 2 m(x) 2 
m(x) 

(l — XT7i(x))' 



1 — imfi) 



(1 



x m 



(x) k ). 



(15) 



Let Pk '■= ^{hfk) for k > 0. Then by (15), we can compute the generating function B(y) 
for f3k as the following: 



B(y) = J2 hV k = E 7 ^ (1 - *V*) V 

*=i fe=i I 1 - zm(a;)) 

m(x) / 1 1 



(l-im(x))^ 1 -!/ l-xm(x)y, 

_ -y(x 2 - x 2 y)m(x) y(x - y + 2xy) 

(1 — y)(l — 3x)(x + xy — y + xy 2 ) (1 — y)(l — 3x)(x + xy — y + xy 2 ) ' 

where the last equation follows by rationalizing the denominator. Then the generating 
function for V(hfj) + *(/i/ fc ) - V(hf j+k ) is 

oo 



j,k=i 

oo 

j,k=i 



T^~B(y) + r^-B^) - E /W** 



i,fc=i 

oo 

: B(y) + ^B^) - — (*B(i/) - yB(s)) . (17) 

1 — v v — Z \ / 



— B(2) - > /3 n 

V ^^ y — z 



\ — Z 1 — y y — 2 

So, plugging equation (16) into (17) gives the generating function for ty(hfj) + *J?(hfi 
^f(hfj+k), which is equal to 

yz(l — yz)m{x) 
(1 - y) (1 + (1 - l/x)y + y 2 ) (1 - z) (1 + (1 - l/x)z + ^ 2 ) 

yz(xyz + xy + xz — yz) 



(I — y) (x + xy — y + xy 2 ) (1 — z) (x + xz — z + xz 2 ) 
Let 

T / x = yz(l - yz) 

lX ' V ' Z) ' (1 - y) (1 + (1 - l/x)y + y 2 ) (1 - z) (1 + (1 - l/x)z + z 2 Y l ] 

and let 

S(x, y) : 



(l-y)(H-(l-x)y + y 2 )' 
Then by equation (14) we have 

oo 

3(x,y) = ^r k (x)y k . 
fc=i 
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We know that when expanded in powers of y, the second term in (18) has only negative 
powers of x. However the left side of equation in (17) has no negative powers of x. So the 
first term in (18) must be cancelled with negative powers of x from the second term in (18). 
Also, the expression (19) has only negative powers of x. Then we simplify the function 

T(l/x,y, Z )- yz{1 ~ yz) 



(1 - y) (1 + (1 - x)y + y 2 ) (1 - z) (l + (1 - x)z + z 2 ) 
yz{\ -yz)S(x,y)S(x,z) 

oo oo 

yzil - yz)^2 / r j (x)y 3 ^r k (x)z k 

j=l fc=l 

oo 

22 {rj{x)r k (x) - rj_i(x)r fc _i(x)) y 3 z k , (20) 

j,k=i 



where r (x) = 0. 

Define the polynomial Tj^{x) by 

Tfl/^^l^^txV?. (21) 

Then by (20) and (21) we have 

r jtk (x) = rj(x)r k (x) - r j _i(x)r fc _i(x). 

Next, let us compute the coefficient of x n ~^^ + ^ 2 ^y : 'z k in the expression T(x,y 
By (21), we have 

[x n -^ ll+M y j z k }T(x,y,z)m(x) = [ X n -^I+IH)] r jjk ( - J m(x) 



z)m[x). 



[x n ~ 


oo 
i=0 


U/ 


[x n ~ 


oo 
-dwl+lwl)] ^ MiXVy, 

i,l=0 


feZ"' 


£ 


Mj^j-n+(|/xi|+|/Lt 2 |),j,fe 





= 2jMi +n _(| Ml | + | M2 |)rj^. 

i 

So, we summarize with the following theorem. 

Theorem 2.2. For positive integers /ii and /12 wii/i /ii > /i2, the number of standard Young 
tableaux of skew shape A/(//i,/i2) over all partitions X of n having at most three parts, filled 
with the numbers 1,2, ... ,n— (/xi + ^2), can be written as the linear combination of Motzkin 
numbers 

i 

11 



where the number M n is the nth Motzkin number, j — \x% + 1, k = \x\ — Hi + 1, and r^^ is 
the coefficient of x % in Tj^ix) = rj(x)rk(x) — rj-i(x)rk-i(x) defined in (21). 

2.2 Focus on the polynomial r n {x) 

Now we study the polynomial r n {x). From (14), we have 



V r n (x)?/ n = 7 w T v 5T- (22) 

~ K ' (1 - V) (1 + (1 - x)y + y 2 ) { ' 

Define polynomials q n {x) by 

J2q n (x)z n = - — . (23) 

^— ' 1 — xz + z z 



n=0 



Then q n (x) = U n (x/2) where U n (x) for all n > is the Chebyshev polynomial of the second 
kind (A093614), which can be defined by the generating function 



1 — 2xz + z 2 

n=0 



£«- 



X)Z . 



Now we are trying to find a formula for r n (x) in terms of the Chebyshev polynomial of 
the second kind. Then by (22) we have 



J2 r n (x + l)y n = — ^- -— . (24) 

^ (l-y)(l-xy + y 2 ) 

So, from (23) and (24), we deduce 

n-X 

r n {x + l) = J2Ui{x/2). 

i=0 

Then we can rewrite (24) as the sum of an even function and an odd function of x: 

y = y{^ + y 2 ) 

(1 -y)(l-xy + y 2 ) (1 -y)(l-xy + y 2 )(l + xy + y 2 ) 

2 

xy 



Let 



P e (x,y) 



1 - y)(l - xy + y 2 )(l + xy + y 2 ) 

y(± + y 2 ) 



(1 -y)(l-xy + y 2 )(l + xy + y 2 ) 



and 



d i \ x y 2 

Po{x,y) :-- 



;i - 2/)(l - xy + y 2 )(l + xy + y 2 ) ' 

Then the following lemma shows that we can express P e (x, y) and P (x, y) as the Cheby- 
shev polynomial of the second kind. 

12 



Lemma 2.2. The even function P e (x,y) and the odd function P (x , y) iny/(l—y)(l—xy+y 2 ) 
can be expressed as the Chebyshev polynomial of the second kind: 



oo 

P e (x,y) = y(l + y) $>»(!) y 2n , (25) 



n=0 

and 



oo 

P (x, y) = (1 + y) £ 0» (|) C/.-i (|) y 2n . (26) 

n=l 

Proof. Let z = \/— 1. Substituting iy 2 for x and — xi for a and b in equation (7) in [10] gives 
us that 

Pe(x,y) 11 



y(l + y) 1 — xy 2 + y 4 1 — a;y 2 + y 4 



E c/ »(i)^"*E c, »( 

n=0 

oo 



x ^ 2n 



n=0 ~ ir. :i) 

oo _ 

» 9<n 

.2/ y 

n=0 



where * denotes the Hadamard product in y. So we have equation (25) 
Similarly, the function P (x,y)/(1 + y) can be written as 

Po(x,y) 1 y 2 



[l + y) ~~ l-xy 2 + y 4 1 - xy 2 + y 4 

x 
.2 



E^(|)» 2 "*E H »(")^ +2 



n=0 n=0 

oo 

= E^(f)Mf> 2 "> 

ra=l 

where * denotes the Hadamard product in y. □ 

By Lemma 2.2 and q n (x) = U n (x/2), the even function P e of x satisfies that 

\2„,2n 



^e(«» y) = y(i + 2/) X] ^(x) 2 y 2 

n=0 

= <?o(^) 2 y + Qo(x) 2 y 2 + <?i(x) V + <?i(x) V + 

oo 

= ^2<ll(n-l)/2}(x) 2 y n , 
n=l 

where g n (a;) is the polynomial in (23) for all n > 0. Also the odd function can be expressed 

oo 

P o(x,y) = ^2q\n/2\{x)q Vn/2 \-i{x)y n . 



as 



n=2 
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So the expression (24) can be written as 

oo 

( 1 _ y )( 1 !_ gy + y 2) = ^(x) 2 y + Yl (9L("-i)/2j ( x ) 2 + ?Ln/2j (x)g Lri /2j-i(a;))y n . (27) 

Therefore, equating coefficients in (27) gives r%(x + 1) = qo(x) 2 and 

r n (x + 1) = gL(n-i)/2j(^) 2 + ?Ln/2j(«)9Ln/2j-i(a?), when n > 2. 
That is, for all m > 0, 

r 2m (a; + 1) = q m -i(x)(q m -i(x) + q m (x)), 
and 

r 2m+ i(x + 1) = q m (x)(q m -i(x) +q m (x)). 
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